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SUMMARY 


The  condition  of  ?incus  (1974)  for  the  estimability  of  covariance 
components  in  normal  models  is  extended  to  the  case  of  singular 
covariance  matrices. 
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1.  INTRODUCTION 


\ 


V 

In  1970  Seely  derived  a  condition  for  the  estimability  of  covariance 
components  by  a  quadratic  form  In  a  general  covariance  component  model. 
For  normally  distributed  variables  P incus  (1974)  Investigated  the  exis¬ 
tence  of  arbitrary  unbiased  estimators  and  obtained  the  same  character¬ 
ization  as  Seely.  In  his  paper  Plncus  assumed  the  parameter  space  has 
a  nonempty  interior  consisting  of  regular  covariance  matrices.  Later 

^ - (c f »-  Klaf  fe  -f!97S)y~  there  was  a  controversy  whether  Pincus'  result 

remains  valid  for  singular  covariance  matrices.  As  a  matter  of  fact, 
one  can  dispense  with  the  regularity  but  not  with  the  nonempty  interior. 
The  latter  condition,  however,  can  be  fairly  weakened.  As  for  invariant 
estimation  one  can  even  replace  the  assumption  of  normality  by  a 
weaker  one.  This  is  analogous  to  Theorem  2  of  H.  Bunke  and  0.  Bunke 


0 


(1974),  which  concerns  estimability  of  the  mean  value. 

/>  «-  x  'J ^ *  <?  ^  ct-4  <-  \i  «* <  ^  "V 

verify  our  result  along  the  same  lines  as  Plncus  (1974)  did 


in  his  original  paper.  But  now  a  coordinate  free  presentation  reduces 
the  proof  to  its  essential  moments  and  in  this  way  permits  also  singular 
covariance  matrices.  The  crucial  point  turns  out  to  be  the  completeness 
of  the  (locally)  best  linear  unbiased  estimator  of  the  expectation. 


C 


2.  RESULT 

Let  y  be  an  n -dimensional  random  variable  with  Ey-XB,  for  sc 
known  n»k  matrix  X  and  unknown  k-vector  6  of  parameters.  The  variance- 
covariance  matrix  of  y  may  have  the  linear  structure 


var 


T  -  ji  Vl  -  V, 


fie©  C  R 


1 


in 

vhftre  Vi  are  given  symmetric  nxn  matrices  and  6  is  a  given  subset  of  R  . 

In  this  model  the  commonly  used  estimators  for  parametric  functions  q'6 
are  quadratic  forms  y'Ay  where  A  is  a  symmetric  nxn  matrix.  This 
estimator  is  invariant  with  respect  to  the  me an  X  if  AX  -  0.  Denoting 
trace (AV)  as  (A,V)  for  symmetric  matrices  the  expected  value  of  a 
quadratic  form  y'Ay  reads 

E(y'Ay)  -  0'X'AXS  +  (A,V0) . 

Thus  y'Ay  is  unbiased  for  q'9  if 

X'AX  •  0  and  (A.Vg)  -  q’0  for  0e0. 

An  example  of  an  estimable  function  that  is  not  quadratlcally 

2 

estimable  is  provided  by  X*0  and  V0  “  I  +  a  I  .  Here  y'y-1 
2 

is  unbiased  for  a  ,  but  no  purely  quadratic  unbiased  estimator  exists 
for  this  parameter.  To  avoid  such  counterexamples  we  consider  estimators 
of  the  form  c+y 'Ay.  (Note  that  the  class  of  estimable  functions  is  not 
enlarged  when  linear  terma  a'y  are  permitted  too.)  The  unbiasedness 
condition  for  c+y 'Ay  becomes 

X'AX  »  0  ,  (A,^)  •  q*h  for  n  e  9-©, 

c  ■  q*0  -  (A,V0)  for  anT 

Seely's  (1970)  condition  of  estlmablllty  is  readily  extended  to 
the  present  case.  We  Introduce  some  more  notations  to  formulate  his 
result  properly.  Let  P«XX+  be  the  projection  onto  im  X,  the  column  space 
of  X,  and  let  M-I-P.  Further,  let  Qq  and  Qj  be  the  mxm  matrices  with 
the  entries 


2 


|  <V«  -  <VMV> 

<Ql)1j  -  (Vj.Vj-rVjP)  . 

Finally  ©“  stands  for  the  subspace  of  all  m-vectors  orthogonal  to  0. 

Proposition  (Seely):  (a)  There  exists  an  unbiased  estimator  c+y'Ay 
of  q'6  if  an  only  if 

q  e  im  Qj  +  (0-0) A  . 

(b)  There  exists  an  invariant  unbiased  estimator  c+y'Ay  of  q'0  if 
and  only  if 

q  e  im  Qq  +  (0-0)A  . 

Our  main  result  is  now  presented  in  the  following  proposition  where 
span  0  denotes  the  subspace  of  Rm  linearly  generated  by  the  elements  of  0. 

Proposition:  Let  0  satisfy  the  assumption 

(1)  span  (0-0)  -  R  •  (0-0)  . 

(a)  If  y  is  normally  distributed  there  exists  an  unbiased  estimator  of 
q’0  if  and  only  if 

* 

(2)  q  e  im  Qj  +  (0-©)A  . 

(b)  If  the  distribution  of  My  depends  only  on  MVgM  (0e0)  then  there 
exists  an  invariant  unbiased  estimator  of  q'0  if  and  only  if 

(3)  q  e  im  Q0  +  (0-©)*  . 

Remark:  Condition  (1)  is  satisfied  when  0  contains  an  inner  point 
relative  to  the  affine  hull  of  0. 


i 


( 
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3.  Proof:  Let  Q  be  the  m*m  matrix 


i.J  ■ 


with  nv  •  MVM  or  II V  •  V-PVP  as  to  whether  we  are  dealing  with  or 
without  invariance.  H  is  an  orthogonal  projection  in  both  cases. 

For  m-vectors  d  we  have 

<*Q«  -  H  «i(V1JIVj)6j  -  (Vfi^V6)  >  0. 

Hence  Q  is  nonnegative  semideflnlte  and  Q5  la  0  if  and  only  if  n 
vanishes . 

Under  the  distributional  assumptions  of  the  proposition  we  are 
going  to  show  that 

l 

(4)  q  e  [(0-6)  O  ker  Q] 

if  q’0  is  (invariant ly)  estimable.  Here  kef  Q  stands  for  the  subspace 
of  all  5  with  Qj  ■  0,  If  in  addition  6  *»  0-n  for  some  9,ri  e  0 
we  have  to  verify  that  q'6  -  0. 


(a)  In  the  non  invariant  case  we  consider  the  BLUE  Gy  of  Xf5  in  the 
normal  model  y  ~  N(X8,V0).  It  is  defined  by 


GX  -  X 


GV0M  -  0 


(see  Drygas  (1970),  Theorem  3.9).  Also  GVQ  -  GV0G'  holds  true  and  there¬ 
fore  GV0 (I-G) *■  0.  This  implies  the  independence  of  x  ■  Gy  and  z  ■  y-Gy. 
hence  the  distribution  of  (x,z)  is 

(x,8)  -  N(XB,GVe)  x  N(O,(I-G)V0)  -  yg  x  v 


4 


Let  9(y)  be  any  unbiased  estimator  of  q*6.  Defining  <Kx, z)  -  +(x+z) 


we  obtain 


q'6  -  E  $(y)  -  E  *  (Gy,  y-Gy) 

-  //  <Kx,z)  v(dz)  Wg(dx)  . 

as  recently  shown  by  Drygas  (1983)  Gy  is  a  complete  statistic.  Therefore 
the  above  equation  leads  to 


:  -  J  ♦(x,X) 


v(dz)  »  q’0 


Pe-a.s. 


Let  N  C  im  X  be  the  y0  -  null  set  of  all  x  in  im  X  such  that 
f(x)  +  q' 0.  Since  lm  GVQ  is  contained  in  im  X  we  can  write 

im  X  -  lm  GV  •  im  X  Pi  (im  GVJ1 

Let  X0  ■  Vq  +  u  according  to  the  above  decomposition.  Then  y^ 
is  concentrated  on  u  +  im  GV0  and  is  absolutely  continuous  with 
respect  to  the  Lebesgue  measure  in  this  linear  manifold.  Thus 


N  :«  {  ve  im  GV  j  ti+v  e  N  } 
u  9 

is  a  null  set  with  respect  to  the  Lebesgue  measure  in  im  GVa.  Since 

0 

this  holds  true  for  arbitrary  u,  Fubini's  Theorem  yields:  N  is  a 
null  set  with  respect  to  the  Lebesgue  measure  XimX  in  im  X.  So  we 


finally  arrive  at 


f(x)  -  q’8 


,  imX 

a  -  a.s. 


Now  we  consider  the  model  ^(XB.V^.  From  Qfi  -  0  we  get 
0  ■  It ■Vj-PV^P.  That  means  V0  -  PVgP  -  -  FV^P  and  therefore 

V0M  -  V^M.  Thus  the  BLUE  Gy  of  X0  in  the  model  y-N(X0,V0)  can  as  well 


I 


I 


serve  In  the  model  y ~N(Xg,V  ).  Also  It  follows  from  VQ  -  V  ■  P(Va-V  )P 

li  e  n  »  h 

thst  G(Vfl-V  )  -  V_-V  and  so  (I-G)V  -  (I-G)Va.  Applying  the  same 
o  n  o  n  n  9 

argument  as  above  now  leads  to 

f(x)  ■  q'n  XimX  -  a.s. 

from  which  q’d  ■  q'0  -  q'n  »  0  follows. 

(b)  To  conclude  the  same  for  an  Invariant  estimator  ^(y)  we  write 
*(y)  ■  i{i(My) .  In  the  Invariant  case  QS  ■  0  means  0  «  II •  M  V{  H, 
i.e.  M  VQ  M  -  M  Vn  M  ,  and  so 

q'0  -  E.  'll  (My)  -  E  v|/(My)  »  q'n  . 

0  T| 

because  the  distribution  of  My  was  assumed  to  depend  on  MV  M  only. 

It  remains  to  be  shown  that  (4)  and  (I)  together  Imply  q e 1m  Q  +  (0-0 ). 
From  (1)  it  follows  that 

span  (0-0) O  ker  Q  -  R  •  ( (0-0)  fi  ker  Q) 

-  span  [(0-6)0  ker  Q] 

Along  with  (4)  this  yields: 

q  e  1(0-0)  O  ker  (J]1  ■  [span(0-0)  O  ker  Q}1 

-  (0-0)1  +  lm  Q 

as  was  to  be  proved. 
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